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ABSTRACT 

Modem  technology  has  enabled  monitoring  of  large 
populations  of  live  cells  over  extended  time  periods  in 
experimental  settings.  Live  imaging  of  cell 
populations  growing  in  a  culture  vessel  has  been 
widely  adopted  in  biomedical  experiments.  Such 
experiments  create  large  amount  of  time-lapse 
images,  and  the  information  embedded  in  these 
images  holds  tremendous  promise  for  scientific 
discovery.  The  growing  amount  of  such  data  calls  for 
automated  or  semi- automated  computer  vision  tools  to 
detect  and  analyze  the  dynamic  cellular  processes,  and 
to  extract  the  information  necessary  for  biomedical 
study.  Live  cells  are  often  of  low  contrast  with  little 
natural  pigmentation,  therefore  they  usually  need  to 
be  stained  or  fixed  in  order  to  be  visible  under  bright 
field  microscopy  or  florescence  microscopy. 
However,  fixing  or  staining  may  destroy  the  cells  or 
introduce  artifacts. 

1.  INTRODUCTION 

Label-free  imaging,  in  particular  phase  contrast 
microscopy,  is  highly  desirable  for  live  cell  imaging 
because  it  allows  cells  to  be  examined  in  their  natural 
state,  therefore  enables  live  cell  imaging  over 
extended  time  periods.  In  computer  vision  literature, 
the  detection  of  cell  division  is  often  referred  to  as 
mitosis  detection.  Mitosis  detection  is  essential  for 
quantitative  analysis  of  cell  populations.  The 
detection  of  mitotic  cells  can  provide  valuable 
information  to  improve  the  performance  of  tasks  such 
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as  cell  tracking  and  lineage  construction.  The 
information  provided  by  mitosis  detection  can  be 
further  utilized  in  biological  and  medical  applications 
such  as  cell  culture  monitoring,  stem  cell 
manufacturing,  drug  development,  tissue  engineering 
and  so  on.  Currently,  the  detection  of  mitosis  is 
typically  performed  by  people  with  biological 
expertise.  However,  detecting  mitosis  from  large 
number  of  cell  images  by  human  is  both  tedious  and 
error  prone. 

The  task  of  computer  vision  based  mitosis  detection 
can  be  further  categorized  into  identification, 
localization  and  segmentation  problems.  Given  a 
static  cell  image  or  a  dynamic  cell  image  sequence, 
the  goal  of  mitosis  identification  is  to  detect  whether 
there  is  mitosis  in  the  input  data.  In  addition,  mitosis 
localization  approaches  can  further  localize  the 
division  of  cells  in  mitotic  process  spatially  and 
temporally  from  the  input  sequence. 
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Figure  l.Four  stages  of  visual  appearance  transition 


Based  on  the  changes  of  visual  appearance  of  stem 
cells  in  phase  contrast  microscopy  images,  mitosis  of 
stem  cells  can  be  segmented  into  four  stages,  and  each 
of  them  is  related  to  biological  phases  in  the  cell 
circle:  1.  Interphase  stage,  when  the  cells  still  looks 
normal  in  appearance;  2.  Start  of  mitosis,  when  the 
cells  begin  to  shrink,  round  up  and  get  brighter  while 
going  through  prophase,  metaphase  and  anaphase;  3. 
Formation  of  daughter  cells,  when  two  daughter  cells 
become  visible  and  attached  with  each  other  forming 
the  shape  ‘8’  at  the  period  of  telophase;  4.  Separation 
of  daughter  cells,  when  two  daughter  cells  get 
completely  sepa-rated  after  cytokinesis  is  completed. 
These  four  stages  in  the  visual  appearance  transition 
are  illustrated  in  figl . 


2.  BACKGROUND  AND  RELATED  WORK: 

State-of-the-art  methods  for  mitotic  event  detection  in 
microscopy  image  sequences  can  be  generally 
classified  into  the  three  following  categories. 


Method 

Precision(%) 

Recall(%) 

3D-CNN  [11] 

70.84 

66.39 

Schuldt  [12] 

74.98 

71.36 

Niebles  [14] 

66.33 

61.04 

Dollar  [15] 

60.84 

62.79 

Jhuang  [16] 

50.04 

49.74 
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Fig  2:  Frame  work  of  our  approach 


The  number  of  mitotic  figures  visible  in  histology 
sections  is  an  important  indicator  for  cancer  screening 
and  assessment.  Normally,  the  count  is  performed 


manually  by  histologists,  but  automating  the  process 
could  reduce  its  time  and  costs  (thus  making  it  more 
accessible),  minimize  errors,  and  improve  the 
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comparability  of  results  obtained  in  different  labs. 
Mitosis  detection  is  very  hard.  In  fact,  mitosis  is  a 
complex  process  during  which  a  cell  nucleus 
undergoes  various  transformations.  In  addition, 
different  image  areas  are  characterized  by  different 
tissue  types,  which  exhibit  highly  variable 
appearance.  A  large  amount  of  different  structures  can 
be  observed  in  histology  images  stained  with 
Hematosin  &  Eosin,  and  in  particular  many  dark-blue 
spots,  most  of  which  correspond  to  cell  nuclei. 

As  an  additional  complication,  in  later  stages  of  the 
mitosis  process  a  nucleus  may  appear  to  split  in  two 
dark-blue  spots,  to  be  counted  as  one  single  mitosis. 
Our  approach  is  conceptually  very  simple.  We  use  a 
supervised  Deep  Neural  Network  (DNN)  as  a 
powerful  pixel  classifier.  The  DNN  is  a  max-pooling 


Stage  1  Stage  2  Stage  3  Stage  4 


(MP)  convolutional  neural  network  (CNN).  It  directly 
operates  on  raw  RGB  data  sampled  from  a  square 
patch  of  the  source  image,  centered  on  the  pixel  itself. 
The  DNN  is  trained  to  differentiate  patches  with  a 
mitotic  nucleus  close  to  the  center  from  all  other 
windows. 


3.  CHALLENGES: 


Unlike  fluorescence  imaging,  phase  contrast 
microscopy  is  a  form  of  nondestructive  imaging 
method.  Under  phase  con-trast  microscope,  cells  can 
be  monitored  alive  and  continu-ously  without 
changing  their  structures.  Therefore,  automated 
systems  can  be  employed  to  observe  and  analyze  cell 
behaviors  by  recording  time-lapse  images  [1]. 


Fig  3  (a-c)  The  dynamic  process  of  mitosis  in  phase  contrast  images, 
(d)  shows  a  non-mitotic  sequences 


Different  from  other  pattern  recognition  tasks,  most 
mitotic  cells  have  irregular  shapes  and  appearance,  as 
shown  in  Figs.  3a,  3b,  and  3c.  Samples  may  vary  in 
orientations  (Figs.  3a  and  3b),  in  appearances  (Fig.  3b 
in  C3H10  dataset  and  Fig.  3c  in  C2C12  dataset),  and 
in  temporal  lengths  (Figs.  3a,  3b,  and  3c). 

Moreover,  some  non-mitotic  sequences  may  have 
similar  appearance  as  mitosis  sequences  (Fig.  3d), 
which  might  cause  false  positives  in  detection. 
Therefore  it  is  not  sufficient  to  simply  search  for  the 
shape  ‘8’  through  phase  contrast  images  to  detect 
mitosis.  Dense  cell  population  data  make  mitosis 
detection  challenging,  and  the  level  of  difficulty  only 
increases  as  live  cells  proliferate  and  further  increase 
the  population  density  where  neighboring  cells 
introduce  ambiguity.  Given  their  large  number  in  a 
single  microscopy  image,  it  is  difficult  to  find  all  of 
them  by  simply  searching  for  a  standard  pattern.  In 
recent  years,  many  approaches  have  been  proposed  to 
solve  this  problem  under  different  applications. 

4.  EXISTING  SYSTEM: 

Mitosis  in  unseen  images  are  detected  by  applying  the 
classifier  on  a  sliding  window,  and  post  processing  its 
outputs  with  simple  techniques.  Because  the  DNN 


operates  on  raw  pixel  values,  no  human  input  is 

needed  :  on  the  contrary,  the  DNN  automatically 
learns  a  set  of  visual  features  from  the  training  data. 
Our  main  contribution  is  a  new,  important,  practical 
application  of  DNN,  which  recently  produced 
outstanding  results  in  image  classification, 
segmentation  and  detection.  Our  approach  is  tested  on 
a  publicly  available  dataset.Our  detector  is  a  DNN- 
based  pixel  classifier.  Windows  of  class  mitosis 
contain  a  visible  mitosis  around  the  window’s  center. 
Others  contain  off-center  or  no  mitosis. 

Deep  Neural  Netwok  architecture  A  DNN  [4]  is  a 
feed-forward  net  made  of  successive  pairs  of 
convolutional  and  max-pooling  layers,  followed  by 
several  fully  connected  layers.  Raw  pixel  intensities 
of  the  input  image  are  passed  through  this  general, 
hierarchical  feature  extractor.  The  feature  vector  it 
produces  is  classified  by  the  fully  connected  layers. 
All  weights  are  optimized  through  minimization  of 
the  misclassification  error  over  the  training  set.  Each 
convolutional  layer  performs  a  2D  convolution  of  its 
input  maps  with  a  rectangular  filter. 
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CONCLUSION: 

In  this  paper  we  used  four  methods.  Among  all  the 
four  methods  deep  learning  method  is  the  best 
solution  for  detecting  mitosis  in  phase  contrast 
microscopy.  Compared  with  hand  crafted  features, 
deep  learning  method  could  leam  more  discriminative 
and  data  relevant  features  directly  from  image  data. 
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